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CLAIMS 

What is claimed is: 

1 . A method for enabUng a front-end load balancing function to a cluster of servers 
functioning as an Internet site for serving end-users, said front-end load balancing 
function and said end-users estabUshing transmission control protocol (TCP) 
connections, said method comprising the steps of: 

spreading said front-end load balancing function over more than one individual 
load balancer (ILB); 

enabling each ILB to consistently self-assert, for said front-end load balancing 
function, an ILB owner for each one of said TCP connections; 

processing an ILB-owned TCP connection on behalf of said load balancing 
function in said each ILB, for each one of said TCP connections owned by each said ILB; 
and 

handing off an unassigned TCP connection to said ILB owner in each said ILB, 
for each one of said TCP cormections not owned by each said ILB. 

2. The method according to claim 1, wherein said enabling step further includes 
steps of: 

consistently self-asserting, for said front-end load balancing function, a back up 
ILB owner for each one of said TCP connections; and 
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utilizing said back up ILB owner to process said ILB owned TCP connection 
should said ILB owner become incapable of processing said ILB owned TCP connection. 

3. The method according to claim 2, wherein said enabling step, further includes 
steps of: 

using a connection unique identifier for each one of said TCP connections; 
using an ILB unique identifier for each said ILB; 
computing a score for each said ILB; 
obtaining a set of scores; 

ranking said set of scores, said ranking step further includes: 
designating said ILB having a best ranked score as said ILB owner; 
designating said ILB having a second best ranked score as said back up ILB 

owner. 

4. The method according to claim 3, wherein said method further includes a step of: 

adding a connection unique identifier use step wherein said connection unique 
identifier is a twelve byte quadruplet including a TCP destination port, an IP destination 
address, a TCP source port, an IP source address. 
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5. The method according to claim 4, wherein said method further includes a step of: 



2 using said ILB unique identifier wherein said ILB unique identifier is an IP 

3 address of said ILB, 

^1 6. The method according to claim 4, wherein said method further includes a step of: 

|| using said ILB unique identifier wherein said ILB unique identifier is an index 

which is unique within said front-end load balancing function. 

7. The method according to claim 3, wherein said ranking step further includes a 

^ i step of: 

Cn 

'"3 ranking on the basis of the arithmetical values of said set of scores. 

1 8. The method according to claim 3, wherein said designating steps further includes 

2 steps of: 

3 selecting the largest arithmetical value of said set of scores as said best ranked 

4 score; and 

5 selecting the second largest arithmetical value of said set of scores as said second 

6 best ranked score. 
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9- The method according to claim 3, wherein said step of computing a score further 
includes a step of: 

calculating a cyclic redundancy check (CRC) code over said ILB unique identifier 
concatenated to said connection unique identifier. 

10* The method according to claim 1, wherein said method further includes a step 
of: 

designating a particular server, out of said cluster of servers due to process each 
said ILB owned TCP connection, with a lookup table of owned connections (LTOC) 
included in each said ILB. 

11. The method according to claim 10 wherein said method further includes a step 
of: 

including in each said LTOC, for each ILB owned TCP connection, said backup 
ILB owner. 

12. The method according claim 1, wherein said method further includes a step of: 

including a cache of all least recently used associations formed, within said front- 
end load balancing function, between each one of said TCP connections with an 
individual server out of said cluster of servers, in each of said ILB. 

13. The method according to claim 3, upon receiving a TCP synchronous idle 
character (S YN) Packet in a receiving ILB, wherein said method further includes steps 
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of: 

computing said set of scores; 

determining said ILB owner and said back up ILB owner; 
checking if said receiving ILB is said ILB owner; 

selecting an individual server to process a new TCP connection, in response to 
determining that said receiving ILB is said ILB owner; 

forwarding said TCP S YN packet to said individual server; 

broadcasting a control packet within said front-end load balancing function 
informing of a new formed association between said new TCP connection, said 
individual server and said back up ILB owner in all ILBs receiving said broadcast control 
packet; 

optionally caching said new formed association; 

testing if said broadcast receiving ILB is selected said backup ILB owner; 

moving forward directly to said completing step, in response to determining that 
said broadcast receiving ILB is not selected said backup ILB owner; 

storing in said LTOC of said broadcast receiving ILB that, for said new TCP 
connection, said broadcast receiving ILB is said back up ILB owner, in response to 
determining that said broadcast receiving ILB is selected said backup ILB owner; 
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forwarding said TCP S YN packet to said ILB owner, in response to determining 
that said receiving ILB is not said ILB owner; 

forwarding said TCP S YN packet to said individual server; 

broadcasting a control packet within said front-end load balancing function 
informing of a new formed association between said new TCP connection, said 
individual server and said back up ILB owner; 

in all ILBs receiving said broadcast control packet; 

optionally caching said new formed association; 

testing if said broadcast receiving ILB is selected said backup ILB owner; 

moving forward directly to said completing step, in response to determining that 
said broadcast receiving ILB is not selected said backup ILB owner; and 

storing in said LTOC of said broadcast receiving ILB that, for said new TCP 
connection, said broadcast receiving ILB is said back up ILB owner, in response to 
determining that said broadcast receiving ILB is selected said backup ILB owner. 

1 4. The method according to claim 3, upon receiving a transmission control protocol 
(TCP) Packet other than a synchronous idle character (S YN), in said receiving individual 
load balancer (ILB), said method further comprising the steps of: 

computing said set of scores; 

determining said ILB owner and said back up ILB owner; 
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6 checking if said receiving ILB is said ILB owner or said back up ILB owner of 

7 a previously established TCP connection; 

8 retrieving in said LTOC of said receiving ILB a corresponding entry for said 

9 previously established TCP connection, in response to said receiving ILB is said ILB 

10 owner or said backup ILB owner of a previously established TCP connection; 



11 forwarding said TCP packet to said individual server according to said LTOC 

12 corresponding entry; 

testing if said TCP packet is a FIN or RST packet; 

iy moving forward directly to said completing step, in response to determining that 

said TCP packet is not a FIN or RST packet; 



broadcasting an end of connection control packet within said front-end load 
balancing function informing all ILBs that said previously established TCP connection 
has terminated thus, that each said cache and said LTOC of said back up ILB owner 
and/or said ILB owner must be updated accordingly, in response to determining that said 
TCP packet is a FIN or RST packet; 

looking up said cache of said receiving ILB for an entry corresponding to said 
previously established TCP connection, in response to determining that said receiving 
ILB is not said ILB owner nor said back up ILB owner of a previously established TCP 



24 connection; 

25 forwarding said TCP packet to said individual server according to said LTOC 

26 corresponding entry, in response to finding an entry corresponding to said previously 

27 established TCP connection; 



testing if said TCP packet is a FIN or RST packet; 



29 



moving forward directly to said completing step, in response to determining that 
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said TCP packet is not a FIN or RST packet; 

broadcasting an end of connection control packet within said front-end load 
balancing function informing all ILBs that said previously established TCP connection 
has terminated thus, that each said cache and said LTOC of said back up ILB owner 
and/or said ILB owner must be updated accordingly, in response to determining that said 
TCP packet is a FIN or RST packet; and 

forwarding said TCP packet to said ILB owner, in response to not finding an entry 
corresponding to said previously established TCP connection. 

15. The method according to claim 14, wherein said method further comprising the 
step of: 

forwarding to said ILB owner said received packet other than a SYN when 
receiving ILB has no cache, in response to determining that said receiving ILB is not said 
ILB owner nor said backup ILB owner of a previously established TCP connection. 

16. The method according to claim 1, wherein said method further comprising the 
step of: 

broadcasting ID messages regularly from each said ILB in order to keep all other 
said ILBs aware of their respective status while each said ILB actively participating, at 
any given instant, in said jfront-end load balancing function. 

17. The method according to claim 16, wherein upon listening for the reception of 
said ID messages, in said receiving ILB said method further comprising the steps of: 
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checking if a new ILB has joined said front-end load balancing function, in 
response to receiving a new ID message; 

continuing ID message monitoring, in response to determining that said new ILB 
has not joined said front-end load balancing function; 

re-computing scores including said new ILB, in response to determining that said 
new ILB has joined said front-end load balancing function for each one of said TCP 
connections currently handled by said receiving ILB as said ILB owner or as said backup 
owner; 

updating a transfer table, said updating step said transfer table further comprising: 

adding said ILB owned TCP connection in said transfer table as now owned by 
said new ILB, in response to determining if said new ILB is elected to become said ILB 
owner and said receiving ILB is elected to become said back up ILB owner; 

changing, in said LTOC of said receiving ILB, state of current TCP connection; 

adding said ILB owned TCP connection in said transfer table as now backup 
owned by said new ILB, in response to determining if said receiving ILB remains to be 
said ILB owner and said new ILB is elected to become said back up ILB owner; 

adding said ILB owned TCP connection in said transfer table as now back up 
owned by said new ILB, in response to determining said new ILB is elected to become 
said back up ILB owner and said receiving ILB is no longer said ILB owner or said back 
up ILB owner; 

deleting, in said LTOC of said receiving ILB, current TCP connection; and 
transferring said transfer table to said new ILB. 
18. The method according to claim 17, wherein upon listening for the reception of 
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said ID messages, in said receiving ILB, said method further comprising the steps of: 

checking if a former ILB has left said front-end load balancing function, in 
response to receiving a new ID message; 

continuing ID message monitoring, in response to determining if a former ILB 
has not left said front-end load balancing function; 

flushing said cache of said receiving ILB of all entries corresponding to said 
former ILB, in response to determining if a former ILD has left said front-end load 
balancing function; 

updating said transfer table, for each one of said TCP connections currently 
handled by said receiving ILB as said ILB owner or as said back up ILB owner, said step 
of updating said transfer table further comprising the step of: 

re-computing a new back up ILB owner among remaining ILBs, in response to 
determining said receiving ILB is said ILB owner and said former ILB was said backup 
ILB owner; 

adding in said transfer table said new back up ILB owner; 

changing, in said LTOC of said receiving ILB, state of current TCP cormection 
so as said receiving ILB becomes a new ILB owner, in response to determining said 
receiving ILB is said back up ILB owner and said former ILB was said ILB owner; 

re-computing a new back up ILB owner; 

adding in said transfer table said new ILB owner and said new back up ILB 

owner; 

transferring said transfer table to all remaining ILBs. 
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19* A system for enabling a front-end load balancing function to a cluster of servers 
together implementing an Internet site for serving end-users, said front-end load 
balancing function and said end-users establishing TCP connections, said system 
comprising: 

means for spreading said front-end load balancing function over more than one 
individual load balancer (ILB); 

means for enabling each ILB to consistently self-assert, for said front-end load 
balancing function, an ILB owner for each one of said TCP connections; 

means for processing an ILB-owned TCP connection in behalf of said load 
balancing function in said each ILB, for each one of said TCP connections owned by said 
each ILB; and 

means for handing off an ILB not owned TCP connection to said ILB owner in 
each said ILB, for each one of said TCP connections not owned by said each ILB. 

20. A computer-readable medium comprising instructions for enabling a front-end 
load balancing function to a cluster of servers together implementing an Internet site for 
serving end-users, said front-end load balancing function and said end-users establishing 
TCP connections, said instruction means comprising: 

instruction means for spreading said front-end load balancing function over more 
than one individual load balancer (ILB); 

instruction means for enabling each ILB to consistently self-assert, for said front- 
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end load balancing function, an ILB owner for each one of said TCP connections; 

instruction means for processing an ILB-owned TCP connection in behalf of said 
load balancing function in said each ILB, for each one of said TCP connections owned 
by said each ILB; and 

instruction means for handing off an ILB not owned TCP connection to said ILB 
owner in each said ILB, for each one of said TCP connections not owned by said each 
ILB. 



